Papers with document understanding models
FlexDoc: Parameterized Sampling for Diverse Multilingual Synthetic Documents for Training Document Understanding Models (2025.emnlp-industry)
Copied to clipboard
Karan Dua, Hitesh Laxmichand Patel, Puneet Mittal, Ranjeet Gupta, Amit Agarwal, Praneet Pabolu, Srikant Panda, Hansa Meghwani, Graham Horwood, Fahad Shah
| Challenge: | Document understanding models require large, diverse, and well-annotated datasets that can cost millions of dollars to collect and maintain. |
| Approach: | They propose a scalable synthetic data generation framework that combines Stochastic Schemas and Parameterized Sampling to produce realistic, multilingual semi-structured documents with rich annotations. |
| Outcome: | Experiments on key information extraction tasks show that the proposed framework improves the absolute F1 score by up to 11% while reducing annotation effort by over 90% compared to traditional hard-template methods. |
Hypergraph based Understanding for Document Semantic Entity Recognition (2024.acl-long)
Copied to clipboard
| Challenge: | Existing document understanding models focus on entity categories while ignoring the extraction of entity boundaries. |
| Approach: | They propose a hypergraph attention document semantic entity recognition framework which uses hypergraph focus to focus on entity boundaries and entity categories at the same time. |
| Outcome: | The proposed framework can improve the performance of existing models on FUNSD, CORD, XFUND and SROIE. |
DocAssistant: Integrating Key-region Reading and Step-wise Reasoning for Robust Document Visual Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document understanding models focus on key information and generate answers straightforwardly . existing models ignore evidence from source documents and lack interpretability . |
| Approach: | They propose a visual encoder that fuses text into visual encoded visual encodes . they use multimodal large language models as data generators and checkers to generate step-wise question-and-answer pairs for document images. |
| Outcome: | The proposed model can answer step-wise questions without compromising the performance of the original model. |
A Critical Analysis of Document Out-of-Distribution Detection (2023.findings-emnlp)
Copied to clipboard
Jiuxiang Gu, Yifei Ming, Yi Zhou, Jason Kuen, Vlad Morariu, Handong Zhao, Ruiyi Zhang, Nikolaos Barmpalios, Anqi Liu, Yixuan Li, Tong Sun, Ani Nenkova
| Challenge: | Existing document understanding models focus on single-modal inputs such as images or texts. |
| Approach: | They propose to use a spatial-aware adapter to adapt transformer-based language models to document domain to exploit multi-modal information. |
| Outcome: | The proposed model significantly improves the OOD detection performance compared to using a standard language model and to competitive baselines. |